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Abstract 


The  United  States  Air  Force  (USAF)  has  outsourced  a  significant  portion  of  their 
activities  defined  as  commercial  activities  and  plans  to  aggressively  outsource  more  in  the 
future.  The  USAF  outsources  its  commercial  activities  in  the  form  of  multi-year 
contracts  to  the  private  sector.  Cost  growth  (either  negative  or  positive)  has  been 
experienced  by  most  of  these  contracts. 

This  research  effort  performed  a  review  of  current  literature  and  used  statistical  analysis 
to  clarify  the  issue:  what  are  the  causes,  and  extent  of  cost  growth  in  USAF  base-support- 
function  contracts? 

To  clarify  the  causes  of  cost  growth  the  following  were  employed:  (1)  A  review  of  the 
Federal  Acquisition  Regulations  (FAR)  in  order  to  understand  how  cost  growth  can  occur 
within  the  context  of  USAF  contracts.  (2)  A  review  of  current  literature  and  government 
publications  concerning  cost  growth  in  USAF  as  well  as  other  government  contracts.  (3) 
A  review  of  cost  growth  in  the  construction  industry  was  accomplished  in  order  that 
possible  further  insights  could  be  gained. 

To  clarify  the  extent  and  explore  the  various  factors  (MAJCOM,  contract  function, 
contract  type,  and  award  year)  the  following  statistical  analysis  on  124  USAF  base 


vii 


support  function  contracts  was  employed;  (1)  descriptive  statistics,  (2)  Kruskal-Wallis 
and  Mann-Whitney  tests  for  statistical  differences,  and  (3)  regression  analysis. 

From  the  literature,  it  can  be  concluded  that  changes  to  the  statement  of  work  or 
performance  work  statements  and  Department  of  Labor  (DOL)  mandated  wage  rates  are 
the  primary  causes  of  cost  growth  in  USAF  as  well  as  other  government  service-type 
contracts.  It  can  also  be  concluded  that  cost  growth  in  the  construction  industry  is  similar 
to  cost  growth  in  USAF  base-support  function  contracts. 

With  respect  to  the  statistical  analysis  of  extent  and  factors  (MAJCOM,  contract  function, 
contract  type,  and  award  year  of  contract),  the  following  can  be  reasonably  concluded. 
Cost  growth  in  USAF  contracts  is  widely  variable.  The  median  value  of  cost  growth  for 
all  contracts  was  4.56  percent,  and  the  inner-quartile  range  value  of  percent  cost  growth 
was  13.63  percent.  Although  relative  differences  do  exist  between  variables  within 
factors,  none  of  the  variables  within  factors  were  statistically  different  at  the  .05 
significance  level.  At  the  .  10  significance  level,  the  variables  within  the  factor  contract 
type  were  shown  to  be  significantly  different.  However,  this  cannot  be  stated  concerning 
the  other  factors  (MAJCOM,  contract  function,  or  award  year  of  contract). 
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ANALYSIS  OF  COST  GROWTH  IN  U.S.  AIR  FORCE  BASE 
SUPPORT  FUNCTION  CONTRACTS 


I.  Introduction 


The  United  States  Air  Force  (USAF)  undertakes  a  great  number  of  activities  in  order  to 
accomplish  its  stated  mission.  The  USAF  defines  these  activities  into  two  broad 
categories:  Governmental  Function  and  Commercial  Activity. 

According  to  Air  Force  Pamphlet  (AFP)  26-12,  “A  governmental  function  is  one  that  is 
so  intimately  related  to  the  public  interest  as  to  mandate  performance  by  Department  of 
Defense  employees.  These  functions  include  those  activities  requiring  either  the  exercise 
of  discretion  in  applying  governmental  authority  or  the  use  of  value  judgment  in  making 
decisions  for  the  government”. 

“A  commercial  activity  is  an  activity  that  provides  a  product  or  service  obtainable  (or 
obtained)  from  a  commercial  source.  A  commercial  activity  is  not  a  governmental 
function.” 
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Outsourcing  in  the  USAF 

Since  1955,  all  federal  agencies  have  been  encouraged  to  obtain  the  performance  of  their 
commercial  activities  from  the  private  sector,  through  either  privatization  or  outsourcing. 
Privatization  involves  the  change  in  ownership  as  well  as  responsibility  for  operating  and 
maintaining  a  commercial  activity.  Privatization  is  relatively  new  to  the  USAF;  however, 
is  becoming  more  utilized.  Outsourcing,  the  more  common  of  the  two,  is  contracting  out 
to  the  private  sector  to  operate  and/or  maintain  a  commercial  activity.  The  government 
still  maintains  ownership  of  the  facilities,  systems  and  equipment  associated  with  the 
commercial  activity  (GAO,  1997:  2). 

There  are  many  reasons  for  outsourcing  commercial  activities.  Outsourcing  can  “enhance 
military  readiness  and/or  quality  of  life.”  (Keating,  1997:  6),  or  “achieve  cost  savings, 
management  efficiencies,  and  operating  flexibility”  (GAO,  1997:  1).  One  might  conclude 
that  outsourcing  by  the  USAF  is  a  potential  way  to  save  money  in  one  area,  particularly 
base  support  or  personnel  costs,  in  order  to  reallocate  the  saved  money  from  outsourcing 
to  other  areas,  such  as  aircraft  procurement  or  construction  of  new  facilities. 

In  1996,  the  USAF  “estimated  that  it  had  outsourced  64  percent  of  its  workforce 
performing  commercial  activities”  (GAO/  1997:5).  This  percentage  equates  to  94,714 
contractor  manpower  equivalents  (CME)  working  for  the  USAF.  A  CME  is  an  estimate 
of  the  number  of  government  employees  who  would  be  required  to  perform  the  function 
that  is  currently  being  performed  by  contract  (Keating,  1997:12). 
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From  1996  to  2003  the  USAF  planned  or  plans  on  studying  up  to  60,000  positions  for 
potential  outsourcing.  The  majority  of  these  positions  are  planned  to  be  within  base 
support  service  billets.  In  order  to  facilitate  and  manage  this  push,  the  USAF  created  an 
Outsourcing  and  Privatization  division  with  the  Air  Staff  (GAO  1997:6). 

It  is  reasonable  to  conclude  from  the  following  information  that  the  USAF  has  not  only 
outsourced  a  significant  portion  of  their  present  workforce  but  plans  to  aggressively 
pursue  outsourcing  in  the  future.  Outsourcing  of  a  commercial  activity  occurs  through 
the  A-76  process. 

The  A-76  Process 

In  1966,  the  Office  of  Management  and  Budget  (OMB)  issued  Circular  A-76.  This 
document  established  the  federal  policy  for  the  performance  of  commercial  services  by 
the  private  sector.  In  1983,  a  supplement  was  issued  which  provided  procedures  for 
determining  whether  a  commercial  activity  should  be  outsourced  or  remain  in-house.  In 
1996,  the  supplement  was  revised  to  streamline  and  improve  the  outsourcing  process 
(GAO,  1997:  2-3). 

The  OMB’s  Circular  A-76  defines  29  types  of  services  (types  of  commercial  activities)  as 
inherently  base  support.  The  following  list,  from  the  1996-Revised  Supplemental 
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Handbook  to  Circular  A-76,  is  provided  so  that  the  reader  may  gain  an  understanding  into 
^ypgg  of  services  which  the  USAF  outsources  and  which  this  research  is  focused  upon. 

1 .  N atural  resource  services 

2.  Advertising  and  public  relations 

3.  Financial  and  payroll  services 

4.  Debt  collection 

5.  Bus  services 

6.  Laundry  and  dry  cleaning 

7.  Custodial  services 

8.  Pest  management 

9.  Refuse  collection  and  disposal  services 

10.  Food  services 

1 1 .  Furniture  Repair 

12.  Office  equipment  maintenance  and  repair 

1 3 .  Motor  vehicle  operation 

14.  Motor  vehicle  maintenance 

15.  Fire  prevention  and  protection 

16.  Military  clothing 

17.  Guard  service 

18.  Electric  plants  and  systems  operation  and  maintenance 

19.  Heating  plants  and  systems  operation  and  maintenance 

20.  Water  plants  and  systems  operation  and  maintenance 

21.  Sewage  and  waste  plants  operation  and  maintenance 

22.  Air  conditioning  and  refrigeration  plants 

23.  Other  utilities  operation  and  maintenance 

24.  Supply  operations 

25.  Warehousing  and  distribution  of  publications 

26.  Transportation  management  services 

27.  Museum  operations 

28.  Contractor-operated  parts  stores  and  civil  engineering  supply 

29.  Other  installation  services  (OMB,  1996) 


Unfortunately,  the  USAF  does  not  have  a  clear  definition  of  commercial  activities  that 
fall  into  the  OMB’s  defined  base  support  funetion  categories  (GAO,  1997:23-24). 
However,  upon  review  of  USAF  base  support  contracts,  all  of  them  might  reasonably  be 
categorized  under  one  or  more  of  the  OMB’s  defined  activities  for  base  support  functions. 
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The  decision  to  outsource  a  base  support  function  or  keep  the  function  in-house  is 
normally  determined  by  the  A-76  process.  This  is  more  commonly  referred  to  as  an  A-76 
Study.  A-76  studies  are  normally  initiated  at  the  Air  Staff  and  MAJCOM  levels  of  the 
USAF.  Local  base  commanders  can  also  initiate  A-76  studies;  however,  this  rarely 
occurs.  The  reasons  for  initiating  an  A-76  study  vary;  however,  as  mentioned  in  the 
previous  section,  a  potential  to  achieve  cost  savings,  management  efficiencies,  and 
operating  flexibility  are  most  commonly  cited.  The  A-76  process  consists  of  six  steps, 
which  are  generally  accomplished  in  the  following  order;  however,  there  is  considerable 
overlap  among  several  of  the  steps: 


1.  Develop  a  performance  work  statement  (PWS)  and  quality  assurance  plan 

2.  Conduct  a  management  study  to  determine  the  government’s  most 
efficient  organization  (MEO) 

3.  Develop  an  in-house  government  cost  estimate  for  the  MEO 

4.  Issue  requests  for  proposals  or  invitation  for  bids 

5.  Evaluate  the  proposals  or  bids  and  comparing  the  in-house  estimate  under 
the  MEO  and  selecting  the  best  proposal 

6.  Addressing  any  appeals  submitted 

The  function  is  outsourced  when,  through  the  A-76  process,  a  contractor  underbids  the 
USAF’s  MEO  estimate  by  at  least  10%,  otherwise  the  function  remains  in-house  and  is 
accomplished  by  using  the  government’s  MEO  (GAO  1998:  22). 


Base  support  functions  are  usually  outsourced  in  the  form  of  multi-year  contracts  (base 
year(s)  plus  option  years).  Typically  these  contracts  last  from  three  to  seven  years.  The 
contracts  can  be  in  many  forms  such  as  firm-fixed  price,  firm-fixed  price  with  incentive. 
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indefinite  delivery  indefinite  quantity,  cost,  and  cost-plus  incentive.  However,  firm-fixed 
price  (FFP)  appears  the  most  prevalent  contract-type  form. 

Cost  Growth  in  Contracts 

It  is  well  accepted  that  most  contracts  experience  cost  growth  during  their  contract  life. 
Cost  growth  is  when  the  final  amount  paid  on  a  contract  does  not  match  the  initial 
amount  when  the  contract  was  awarded.  The  extent  of  cost  growth  can  be  negative  or 
positive,  and  is  the  result  of  various  causes  and  factors. 

Research  Question 

The  USAF  has  outsourced  a  significant  portion  of  their  commercial  activities  and  plans  to 
outsource  a  great  number  more  in  the  future.  It  is  therefore  useful  to  attempt  to  more 
clearly  understand  the  extent,  causes,  and  factors  of  cost  growth  in  outsourced 
commercial  activities.  This  research  effort  focuses  on  the  following  question:  what  are  the 
extent  and  causes  of  cost  growth  in  outsourced  base  support  functions  at  USAF  bases? 

In  order  to  clarify  the  causes  of  cost  growth,  the  following  were  employed: 

(1)  A  review  of  the  Federal  Acquisition  Regulations  (FAR)  was  conducted  in 
order  to  understand  how  cost  growth  can  occur  within  the  context  of  USAF 
contracts. 

(2)  A  review  of  current  literature  and  government  publications  concerning  cost 
growth  in  USAF  as  well  as  other  government  contracts  was  conducted. 
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(3)  A  review  of  cost  growth  in  the  construction  industry  was  conducted  in  order 
that  possible  further  insights  could  be  gained,  since  little  information  exists 
concerning  cost  growth  in  service-type  contracts  and  much  research  has  been 
conducted  in  the  construction  industry. 

To  clarify  the  extent  and  explore  the  various  factors:  MAJCOM,  contract  function, 
contract  type,  and  award  year,  the  following  statistical  analysis  on  124  USAF  base 
support  function  contracts  was  employed. 

(1)  Descriptive  statistics  were  used  to  present  an  overall  understanding  of  the 
extent  of  cost  growth  within  the  aforementioned  factors. 

(2)  Kruskal-Wallis  and  Mann-Whitney  tests  for  statistical  differences  between 
variables  within  factors  were  conducted. 

(3)  Regression  analysis  was  conducted  in  order  to  determine  whether  cost  growth 
is  increasing,  decreasing,  or  remaining  constant  over  time  for  the  factor  award 
year  of  contract. 
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11.  Literature  Review 


Overview 

The  literature  review  chapter  of  this  research  focuses  on  five  areas:  (1)  a  discussion  of 
potential  causes  for  cost  growth  in  USAF  contracts  as  listed  in  the  Federal  Acquisition 
Regulation  (FAR),  (2)  a  discussion  of  the  USAF’s  experiences  with  cost  growth  in 
outsourced  commercial  activities  is  presented  (3)  a  discussion  of  cost  growth  with  respect 
to  the  construction  industry,  (4)  a  discussion  of  the  comparisons  between  cost  growth  in 
the  USAF  and  the  construction  industry,  and  (5)  summary  of  the  literature  reviewed. 


Causes  of  Potential  Cost  Growth  in  USAF  Contracts 

The  purpose  of  this  section  of  the  research  is  to  provide  the  reader  with  an  understanding 
of  the  primary  causes  of  cost  growth,  which  are  allowed  by  the  government  in  their 
contracts.  The  three  primary  causes  of  cost  growth,  which  are  allowed  by  the  government 
under  the  Federal  Acquisition  Regulation  (FAR),  are  changes,  delays,  and  adjustments  to 
Department  of  Labor  wage  rate.  Arnavas  and  Ruberry,  in  their  book.  Government 
Contract  Handbook,  provide  an  excellent  understanding  of  these  three  causes. 

A  change  is  an  alteration  of  the  contract  documents  within  the  general  scope  of  the 
contract.  Changes  in  the  following  are  allowed  under  the  FAR: 

1. )  Drawings,  designs,  or  specifications 

2. )  Method  of  shipment  or  delivery 

3. )  Place  of  delivery  (Arnavas  and  Ruberry,  1994:  11-1-11-23) 
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Changes  may  result,  according  to  the  FAR,  from  the  following: 

1. )  Value  Engineering  -  a  change  originated  by  the  contractor  which  results  in 
savings  due  to  a  change  in  method  of  operation  or  installation.  The  contractor 
shares  in  the  generated  savings. 

2. )  Formal  Change  -  a  change  originated  by  either  the  government  or  the 
contractor  with  the  purpose  of  changing  the  requirements  of  the  contract.  A 
formal  change  order  can  be  either  unilateral  or  bilateral. 

3. )  Constructive  Change  -  is  any  action  or  inaction  by  the  government  which  is 
not  a  formal  change  order  but  nonetheless  has  the  effect  of  requiring  the 
contractor  to  perform  additional  work  beyond  the  contract’s  requirements. 
Constructive  changes  are  further  divided  into  five  subtypes: 

a. )  Contract  interpretation  -  occurs  when  the  government  interprets  the 
contract  to  require  work  that  is  more  costly  than  the  work  contemplated  by 
the  contractor. 

b. )  Interference  and  failure  to  cooperate  -  occurs  when  the  government 
increases  the  contractor’s  cost  of  performance  by  actively  interfering  with 
the  progress  of  the  work  or  failing  to  cooperate  with  the  contractor. 

c. )  Defective  specifications  -  occur  when  the  contractor  incurs  additional 
costs  attempting  to  comply  with  specifications  due  to  improperly  prepared 
specifications  or  specifications  that  call  for  performance  which  cannot  be 
attained. 
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d.)  Nondisclosure  of  vital  information  -  occurs  when  the  government 
withholds  information  that  is  necessary  for  the  contractor  to  achieve 


satisfactory  performance. 

e.)  Acceleration  -  occurs  when  the  contractor  is  ordered  or  induced  to 
incur  additional  costs  to  accelerate  the  work  to  complete  performance  prior 
to  the  time  the  contract  requires  (Arnavas  and  Ruberry,  1994:  11-1-1 1-23). 

A  delay  is  an  interference  of  the  contractor’s  performance  for  various  reasons  that  do  not 
allow  for  the  completion  of  the  requirements  within  the  time  allowed  under  the  contract 
requirements.  Delays  can  be  the  fault  of  the  government,  the  contractor  or  neither. 

Delays  are  broadly  categorized  as  constructive  suspension,  constructive  delay,  or 
excusable  delay  (Arnavas,  and  Ruberry,  1994:  12-1-12-1 1). 

A  constructive  suspension  normally  occurs  through  a  “Stop  Work  Order”  issued  by  the 
contracting  officer.  The  “Stop  Work  Order”  requires  the  contractor  to  stop  all  or  partial 
work  on  a  contract.  A  constructive  suspension  can  occur  without  a  “Stop  Work  Order” 
(Arnavas  and  Ruberry,  1994:  12-1-12-11). 

A  constructive  delay  is  divided  into  the  following  sub-categories  of  delays  (Arnavas  and 
Ruberry,  1994:  12-1-12-11): 

1 .)  Delays  involving  changes  -  result  from  a  change  that  is  ordered  by  the 
contracting  officer. 
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2. )  Delays  involving  faulty  specifications  -  result  from  inadequate  or  faulty 
specifications  or  plans  governing  the  performance  of  work. 

3. )  Delays  in  furnishing  property  -  result  from  the  failure  of  the  government  to 
timely  provide  materials  or  equipment  for  the  contractor’s  use  in  the  performance 
of  the  contract. 

4. )  Delays  in  approval  or  inspection  of  work  -  result  from  the  government’s 
failure  to  inspect  or  approve  a  contractor’s  submitted  documentation  or  completed 
work  in  a  timely  manner. 


An  excusable  delay  is  a  delay  that  results  in  the  contractor’s  nonperformance  of  work  that 
is  out  of  the  contractor’s  control  and  occurs  without  fault  or  negligence  by  the  contractor. 
The  following  list  is  generally  accepted  as  reasons  for  possible  excusable  delays: 

1. )  Acts  of  God 

2. )  Acts  of  the  government  in  either  its  sovereign  or  contractual  capacity 

3. )  Fires 

4. )  Floods 

5. )  Epidemics 

6. )  Quarantine  restrictions 

7. )  Strikes 

8. )  Freight  Embargoes 

9. )  Unusually  severe  weather 

10. )  Subcontractor  or  supplier  delays  arising  from  unforeseeable  causes 

beyond  the  control  and  without  the  fault  or  negligence  of  either  the 
contractor  and  subcontractor  or  supplier  (Arnavas  and  Ruberry,  1994:  12- 
1-12-11). 


The  Department  of  Labor  (DOL)  through  The  Service  Contract  Act  requires  contractors 
engaged  in  federal  contracts  to  pay  their  employees  not  less  than  the  prevailing  wage  as 
determined  by  the  Department  of  Labor,  based  on  the  type  of  work  and  location.  When 
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the  prevailing  wage  increases,  contracts  must  be  modified  to  reimburse  contractors  for  the 
increased  cost  of  paying  their  employees  (Arnavas  and  Ruberry,  1994:  6-16). 

It  would  be  reasonable  to  conclude  from  the  previous  information  that  changes  and 
delays,  which  often  result  in  cost  growth,  can  occur  for  a  variety  of  reasons.  In  addition, 
it  can  be  stated  that  these  changes  and  delays  result  in  changes  to  the  statement  of  work  or 
performance  work  statement. 

USAF  Experience  With  Cost  Growth 

The  purpose  of  this  portion  of  the  research  is  to  determine  through  a  review  of  available 
literature  the  causes  of  cost  growth  in  USAF  base  support  function  contracts. 

The  General  Accounting  Office  (GAO)  found  that  “inadequately  crafted  statements  of 
work  have  necessitated  changes  to  contracts,  which  have  often  resulted  in  cost  increases” 
and  also  found  that  “increases  in  federally  established  wage  rates  ...  as  a  source  of 
increased  contract  costs”  (GAO,  1997:  5). 

The  Air  Force  Audit  Agency  (AFAA,  1998)  similarly  concluded  that  changes  in 
performance  work  statements  and  increases  in  labor  wage  rates  resulted  in  increases  in 
cost  growth  of  commercial  activity  contracts. 
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Additionally,  in  an  audit  of  20  commercial  activity  contracts,  the  Department  of  Defense 
Inspector  General  (DOD IG,  1996:  2)  found  cost  growth  had  occurred  in  18  of  the 
contracts  due  to  changes  to  the  performance  work  statement  or  DOL  mandated  wage 
increases. 

The  three  aforementioned  reports  both  cited  changes  in  performance  work  statements  as 
one  of  the  primary  reasons  for  cost  growth  in  USAF  commercial  activity  contracts. 
However,  they  do  not  state  what  types  of  changes  have  caused  the  most  or  least  increase 
in  cost  (i.e.,  particular  areas  in  the  FAR  to  which  the  changes  fall  under). 

The  other  primary  source,  as  mentioned  in  the  three  reports,  was  increases  in  labor  wage 
rates.  As  previously  mentioned.  The  Service  Contraet  Act  requires  eontractors  engaged  in 
federal  contracts  to  pay  their  employees  not  less  than  the  prevailing  wage  as  determined 
by  the  Department  of  Labor,  based  on  the  type  of  work  and  loeation.  When  the  prevailing 
wage  increases,  contracts  must  be  modified  to  reimburse  contractors  for  the  increased 
cost  of  paying  their  employees  (GAO  1997:  6). 

It  is  reasonable  to  conclude  from  the  previous  information  that  the  primary  causes  of  cost 
growth  are  due  to  changes  to  the  performance  work  statement  (PWS)  or  statement  of 
work  (SOW)  and  changes  to  the  wage  rate  as  determined  by  the  DOL.  As  stated  before, 
none  of  the  reports  or  audits  offers  exact  causes  associated  with  particular  changes  to  the 
PWS  or  SOW.  Unfortunately,  the  data  used  in  this  research  does  not  support  additional 
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insight  either.  This  would  be  a  good  area  for  future  research,  due  to  the  fact  insight 
regarding  particular  changes  could  be  would  be  incredibly  useful  information. 

Construction  Industry  Cost  Growth 

The  purpose  of  this  section  of  the  research  is  to  determine  if  additional  insight  regarding 
cost  growth  in  USAF  base  support  contracts  can  be  garnered  from  studies  which  occurred 
in  the  construction  industry.  This  research  focuses  on  construction  industry  cost  growth 
for  two  reasons.  First,  little  information  exists  regarding  cost  growth  in  service-t)^e  (i.e., 
commercial-activity  type)  contracts,  either  in  the  public  or  private  sector.  Second, 
numerous  studies  have  been  concluded  regarding  cost  growth  in  the  construction  industry. 
Although  construction  contracts  differ  from  service-type  contracts,  they  still  contain  many 
similarities  with  service-type  contracts.  The  similarities  include  the  fact  construction  and 
service  contracts  are  structured  in  basically  the  same  way.  In  addition  they  both  involve 
the  providing  of  an  overall  service  to  a  customer  by  an  independent  contractor.  They 
differ  in  the  fact  that  construction  contracts  are  normally  of  a  shorter  duration  thereby 
precluding  the  development  of  a  long-term  relationship  between  the  customer  and  the 
contractor. 
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Baldwin  &  Manthei  (1971)  studied  the  severity  (importance)  of  construction  delays  as 
determined  through  a  survey  of  contractors,  architects,  and  engineers.  The  following 


causes  (in  no  particular  order)  were  given  to  the  survey  respondents  to  rank: 

Weather  Labor  Supply 

Subcontractors  Design  Changes 

Shop  Drawings  Foundation  Changes 

Material  Shortages  Manufactured  Items 

Sample  Approvals  Jurisdiction  Disputes 

Equipment  Failure  Contracts 

Construction  Mistakes  Inspections 

Finances  Permits 

Building  Codes 


The  three  groups  (architects,  contractors,  and  engineers)  ranked  weather,  labor,  and 
subcontractors  as  the  top  three  causes  of  delay  (Baldwin  and  Manthei,  1971). 


The  purpose  of  an  effort  by  Diekmann  &  Nelson  (1985)  was  to  ascertain  the  frequency, 
severity,  and  possible  causal  factors  of  various  construction  claims  in  federally 
administered  construction  projects.  The  authors  used  the  following  causes  of  claims  in 
their  research: 


Design  Errors 
Changes  (Mandatory) 

Weather 

Strike  (including  labor  wage  disputes) 


Changes  (Discretionary) 
Differing  Site  Conditions 
Value  Engineering 
Other 


Diekmann  &  Nelson  (1985)  found  that  design  errors  accounted  for  72  percent  of  claims. 


Thurgood  et  al.  (1990),  through  a  combination  of  interviews  with  contractors  and  state 
employees  and  an  analysis  of  800  highway  projects,  attempted  to  determine  the  causes  of 
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cost  overruns  on  Utah  Department  of  Transportation  construction  projects.  They  used  the 
following  categories  for  causes  of  cost  overruns; 


Quantity  estimate  error 
Time  estimate  error 
Archaeological 
Field  Design  Changes 
Labor  violation/dispute 
Traffic  control  problem 
Weather 
Utility  relocation 
Other 

Traffic  safety  improvements 
Surface  water 


Technical  design  error 
Unclear  Specifieation 
Environmental  problems 
Groundwater 
Subsoil 

Traffic  damage 
Construction  materials 
Zoning  ehange  approval 
Other 

Design  concept  change 


Thurgood  et  al.  (1990)  found  that  quantity  estimate  errors,  technical  design  errors,  time 
estimate  errors,  and  field  design  changes  had  occurred  in  large  percentages  of  the  total 
projects  analyzed. 


Unlike  most  other  researchers,  Hinze  et  al.  (1992)  attempted  to  determine  faetors  that 

have  strong  association  with  cost  overruns  in  contracts.  They  used  the  following  areas  of 

analysis: 

Project  size 
Projeet  type 
Number  of  Bidders 

Range  or  spread  of  submitted  bid  amounts 
Cost  overruns  attributable  to  specific  contractors 
Time  overruns 


They  found  that  cost  overruns  tend  to  increase  with  the  size  of  the  project.  In  addition, 
they  found  that  as  the  number  of  bidders  increased  so  did  the  range  or  spread  in  the  bid 
amounts,  which  is  associated  with  inereased  overruns. 
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O’Conner  et  al.  (1993)  attempted  to  provide  insight  into  both  the  classification  and 

frequency  of  claims  with  respect  to  damage  type,  highway  project  element,  and 

fundamental  causes  of  claims  on  Texas  Department  of  Transportation  projects.  They 

used  the  following  causes  in  their  analysis  (in  order  of  frequency): 

Defective  contract  documents 
Differing  site  conditions 
Compensable  delays 
Excusable  delays 
Hindered  productivity 
Maladministration 
Implied  warranty 
Constructive  changes 
Directed  changes 

Economic  impossibility  of  performance 


They  found  that  defective  contract  document,  compensable  delays  and  hindered 
productivity  to  be  the  most  prevalent  source  of  claim. 


Semple  et  al.  (1994)  analyzed  the  causes  of  claims,  delays,  and  cost  overruns  in  24 
construction  projects  in  Western  Canada.  Semple  et  al.  hypothesized  the  following 
causes  in  their  analysis: 

Acceleration  Restricted  access 

Weather  Increase  in  Scope  (design  changes,  extra  work,  errors) 


They  found  increase  in  scope  as  the  most  prevalent  cause  of  claim. 
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Kaming  et  al.  (1997)  attempted,  through  the  survey  of  31  project  managers  of  high-rise 
construction  projects  in  Indonesia,  to  identify  and  analyze  factors  (causes)  which 
influence  time  and  cost  overruns.  The  following  factors  were  identified  and  analyzed: 
Delays 

Weather 

Inaccuracy  of  materials  estimate 

Inaccurate  prediction  of  craftsman  production  rate 

Inaccurate  prediction  of  equipment  production  rate 

Materials  shortage 

Equipment  shortage 

Skilled  labor  shortage 

Locational  restriction 

Inadequate  planning 

Poor  labor  productivity 

Design  changes 

Cost  Overruns 

Weather 

Material  cost  increase 
Inaccurate  quantity  take-off 
Increase  labor  cost 
Lack  of  expertise 


They  found  that  design  changes  accounted  for  delays  and  material  cost  increases  for  cost 
overruns  to  be  the  most  prevalent  causes  as  ranked  by  the  survey  respondents. 


The  purpose  and  research  methodology  between  articles  varied  greatly;  however,  for 
purposes  of  research  in  this  paper  the  categories  or  causes  of  cost  growth  were  the  focus. 
The  causes  or  categories  of  cost  growth  (whether  in  the  form  of  delays  or  claims)  varied 
greatly.  The  disparity  among  researchers’  findings  regarding  causes  or  categories  of  cost 
growth  is  due  to  several  factors:  (1)  there  is  no  industry  accepted  standard  for 
categorizing  causes  of  cost  growth,  (2)  many  of  the  papers  focused  on  specific  types  of 


18 


construction  situations  or  locations,  and  (3)  causes  in  one  paper  may  be  called  a  different 
name  in  another  paper. 

Comparison  between  Cost  Growth  in  the  USAF  and  Construction  Industry 

In  four  of  the  reviewed  articles,  either  one  or  a  combination  of  the  following  were  cited: 
design  errors,  quantity  estimate  errors,  technical  design  errors,  time  estimate  errors, 
defective  contract  documents,  and  increases  in  scope  (design  changes,  extra  work,  errors) 
as  primary  causes  of  claims  or  cost  overruns.  These  previously  cited  causes  all  relate  to 
improperly  prepared  statements  of  work  or  performance  work  statements. 

It  is  reasonable  to  conclude  from  the  previous  paragraph  as  well  as  from  the  section  of 
this  research  dealing  with  USAF  Experience  With  Cost  Growth,  that  the  USAF  is  not 
unique  in  their  inability  to  consistently  construct  adequate  statement  of  works  or 
performance  work  statements.  This  conclusion  is  due  to  the  fact  the  three  reports  or 
audits  cited  improperly  prepared  statements  of  work  or  performance  work  statements  as 
one  of  the  primary  causes  of  cost  growth. 

Although  none  of  the  articles  dealt  with  labor  price  increases  as  a  form  of  cost  growth,  it 
is  interesting  to  note  that  Kaming  et  al.  (1997)  found  material  cost  increases  were  the 
primary  cause  of  cost  overruns.  A  parallel  (if  somewhat  weak)  can  be  drawn  between  the 
rise  in  material  costs,  due  to  local  price  increases,  and  the  fact  that  the  GAO,  AFAA,  and 
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DOD IG  reports  cite  rises  in  the  Department  of  Labor  mandated  wage  rate  as  a  primary 
cause  cost  growth  in  contracts. 

Summary  of  Literature  Reviewed 

From  the  literature,  several  conclusions  can  be  reasonably  made.  First,  changes  to  the 
statement  of  work  or  performance  work  statements,  whether  in  the  form  of  changes  or 
delays  as  outlined  in  the  FAR,  are  a  primary  cause  of  cost  growth  in  US  AF  commercial 
activity  contracts.  Second,  changes  to  the  DOL  mandated  wage  rate  is  the  other  primary 
cause  of  cost  growth.  Third,  while  this  research  was  hoping  to  gain  possible  additional 
insight  into  cost  growth  for  USAF  contracts  from  construction  industry  literature,  it  could 
be  reasonably  concluded  that  causes  of  cost  growth  in  USAF  contracts  are  not  all  that 
different  from  causes  of  cost  growth  in  the  construction  industry. 

Due  to  the  fact  the  causes  of  cost  growth,  in  USAF  and  DOD  commercial  activity 
contracts  can  be  reasonably  concluded  as  stated  above,  this  research  will  now  focus  on 
the  extent  and  factors  (in  particular  MAJCOM,  contract  function,  contract  type,  and 
award  year  of  contract)  associated  with  cost  growth  for  USAF  commercial  activity 
contracts,  particularly  those  in  the  base  support  function  area. 
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III.  Methodology 


Overview 

The  purpose  of  this  methodology  is  to  attempt  to  determine  the  extent  and  explore  various 
factors,  in  particular  MAJCOM,  contract  function,  contract  type  and  award  year  of 
contract,  associated  with  cost  growth.  The  methodology  section  of  this  research  effort 
focuses  on  three  areas:  (1)  characterization  of  the  data,  (2)  strengths  and  weaknesses  of 
the  data,  and  (3)  statistical  methods  employed. 

Characterization  of  Data 

The  Air  Force  Audit  Agency  gathered  data  in  order  to  accomplish  a  Management 
Advisory  Service  request  and  provided  the  information  for  this  research  effort.  Cost 
growth  and  descriptive  information  on  124  USAF  commercial  activity  contracts  were 
used  in  this  research  effort.  All  of  the  contracts  were  on  active-duty  bases  (as  opposed  to 
Air  National  Guard  or  Air  Force  Reserve  bases),  were  awarded  between  1986  and  1994, 
and  were  completed  contracts  (meaning  they  were  not  active).  In  addition,  all  contracts 
were  at  locations  within  the  Continental  United  States  (CONUS).  The  sample  of  124 
contracts  is  believed  to  be  as  random  as  could  possibly  be  obtained. 
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The  information  regarding  each  contract  consisted  of  the  following: 

(1)  Location  (i.e.,  USAF  installation  name  at  which  the  contract  was  undertaken) 

(2)  Major  Command  (MAJCOM) 

(3)  Description  of  Contract  Function  (i.e.,  Postal  Service,  Furnishings 

Management,  Grounds  Maintenance,  etc) 

(4)  Type  of  Contract  (Firm  Fixed  Price,  Cost-Plus,  etc) 

(5)  Award  Date 

(6)  Original  Contract  Cost 

(7)  Final  Contract  Cost 

(8)  Total  Cost  Growth 

[Final  Contract  Cost]  -  [Original  Contract  Cost]  (1) 

(9)  Adjusted  Final  Contract  Cost 

Due  to  the  fact  some  contracts  had  extensions  of  performance  because  of 
the  USAF’s  inability  to  award  a  successive  contract  before  existing 
contract  expired.  This  “growth”  cannot  be  counted  with  the  cost  growth  of 
the  contract  due  to  the  performance  of  the  service  provided  was  needed. 

(10)  Adjusted  Cost  Growth 

[Adjusted  Final  Contract  Cost]  -  [Original  Contract  Cost]  (2) 

(11)  Percent  Cost  Growth 

To  equally  compare  contracts  of  different  award  amounts,  percent  cost 

growth  is  used.  Percent  cost  growth  is  calculated  by 

[Adjusted  Cost  Growth]  /  [Original  Contract  Cost]*  100  (3) 
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Organizing  the  data  into  1  independent  (All  Contracts)  and  4  dependent  factors 
(MAJCOM,  contract  function,  contract  type,  and  award  year  of  contract)  is  intended  to 
provide  an  understanding  of  the  contracts  which  were  used  for  this  research  effort,  as  well 
as  to  provide  a  basis  for  defining  the  strengths  and  weakness  of  the  data: 

Figure  1  reflects  the  distribution  of  all  the  contracts  according  to  their  MAJCOM.  The 
five  MAJCOMs  (ACC,  AETC,  AFMC,  AFSPC,  and  AMC}  represent  five  out  of  the  six 
MAJCOMs  located  in  the  Continental  United  States  (CONUS).  Data  for  Air  Force 
Special  Operations  Command  (AFSOC)  was  not  available;  however,  AFSOC  only  has 
one  USAF  installation  located  in  the  CONUS  (Airman:  19). 


Number  of  Contracts  by  MAJCOM 


Command  and  Training  Materiel  Command  Command 

(ACC)  Command  Command  (AFSPC)  (AMC) 

(AETC)  (AFMC) 

Variables  with  the  factor  MAJCOM 


Figure  1  -  Number  of  Contracts  by  MAJCOM 
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Figure  2  reflects  the  distribution  of  all  the  contracts  according  to  their  contract  function. 
In  order  to  maintain  adequate  variable  sample  sizes  for  statistical  analysis,  all  variables 
with  three  or  less  cases  were  grouped  into  the  variable  Other-Contract  Functions. 


Figure  2  -  Number  of  Contracts  by  Contract  Function 


Figure  3  reflects  the  distribution  of  all  the  contracts  according  to  their  contract  type.  In 
order  to  maintain  adequate  variable  sample  size  for  statistical  analysis  considering  the 
large  sample  size  of  Firm-Fixed-Price,  all  other  contract  types  were  grouped  into  the 
variable  Other-than-Firm-Fixed  Price. 
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Firm-Fixed  Price  Other  than  Firm-Fixed  Price 

Variables  with  the  factor  Contract  Type 


Figure  3  -  Number  of  Contracts  by  Contract  Type 


Figure  4  reflects  the  distribution  of  all  the  contracts  according  to  the  year  that  they  were 
awarded.  It  is  noteworthy  from  the  figure  that  the  majority  of  contracts,  99  out  of  124 
contracts,  were  awarded  between  the  years  1990  -  1994. 


Number  of  Contracts  by  Award  Year 


1986  1987  1988  1989  1990  1991  1992  1993  1994 


Variables  with  the  factor  Award  Year  of  Contract 


Figure  4  -  Number  of  Contracts  by  Award  Year 


The  contracts  analyzed  in  this  research  range  in  initial  award  cost  of  $44,096  to 
$44,018,657;  however,  from  the  following  figure  it  is  apparent  that  the  great  majority, 
1 15  out  of  124  contracts,  was  awarded  for  less  than  a  total  of  $10,000,000.  Figure  5 
shows  the  distribution  of  initial  award  amount  from  lowest  to  highest. 


Award  Cost  from  Lowest  to  Highest 


Contracts  in  Order  of  Award  Cost 
(not  cumulative) 


Figure  5  -  Award  Cost  of  All  Contracts  from  Lowest  to  Highest 


Strengths  and  Weaknesses  of  the  Data 

The  strength  of  the  data  is  based  upon  the  fact  that  the  data  was  randomly  collected 
almost  simultaneously  by  a  homogeneous  group  of  auditors.  In  addition,  the  data  is 
perhaps  the  only  type  of  its  kind  in  existence. 


The  limitations  of  the  data  stem  from  the  fact  that  when  percent  cost  growth  is  calculated 
for  each  of  the  variables  within  the  factors,  as  described  in  the  proceeding  paragraphs, 
they  do  not  fall  under  one  or  a  consistent  set  of  distributions.  For  this  reason,  only  non- 
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parametric  tests  can  be  used  to  determine  statistical  differences  between  variables  within 
factors.  Finally,  it  is  not  known  whether  the  data  is  a  good  representative  sample  of 
USAF  base  support  function  contracts  awarded  between  1986  -1984.  For  this  reason, 
tests  for  statistical  differences  will  only  be  employed  at  the  0.05  and  0.10  significance 
level. 

Statistical  Methods  Employed 

In  order  to  determine  the  extent  and  factors  (MAJCOM,  contract  function,  contract  type, 
and  award  year  of  contract)  this  research  effort  focuses  on  three  statistical  methods;  (1) 
descriptive  statistics,  (2)  non-parametric  statistics,  and  (3)  linear  regression.  The  purpose 
of  each  is  explained  in  the  following  paragraphs: 

Descriptive  Statistics  is  used  to  present  an  overview  of  the  extent  of  cost  growth  for  all 
contracts  collectively  an4  the  four  factors  (MAJCOM,  contract  function,  contract  type, 
and  award  year  of  contract).  The  mean,  standard  deviation,  minimum,  median, 
maximum,  and  inner-quartile  range  values  of  percentage  of  cost  growth  are  presented  for 
all  Contracts  collectively  as  well  as  for  all  variables  with  the  four  factors.  All  values  are 
computed  using  the  STATISTIX  software  package.  In  addition,  median  and  inner- 
quartile  range  ranks  tables,  as  well  as  median  with  inner-quartile  range  charts,  are  used  to 
present  relative  (not  statistical)  differences  between  variables  within  the  four  factors 
analyzed  in  this  research.  Finally,  for  all  contracts  collectively  ExpertFit®  is  used  to 
determine  the  distribution  for  percent  cost  growth.  This  will  provide  a  basis  for 


27 


computing  probabilities  falling  below,  exceeding,  or  falling  in  an  interval  of  percent  cost 
growth.  ExpertFit®  attempts  to  fit  data  sets  within  17  known  continuous  distributions.  It 
then  ranks  the  distributions  from  highest  to  lowest  according  to  the  distribution  the  data 
most  likely  fits.  ExpertFit®  then  provides  one  of  three  possible  characterizations,  based 
upon  a  heuristic  evaluation,  of  how  good  the  data  fits  the  particular  reuiked  distributions. 
The  three  possible  characterizations  are  “good  representation”,  “borderline 
representation”,  and  bad  representation”.  A  “good  representation”  characterization  by 
ExpertFit®  means  the  particular  distribution  represents  the  data  well,  while  a  “borderline 
representation”  recommends  caution  before  accepting  the  distribution  as  representative  of 
the  data,  and  finally  a  “bad  representation”  does  not  recommend  using  the  distribution  for 
representing  the  data. 

Non-parametric  statistics,  in  particular,  the  Kruskal-Wallis  One-Way  Analysis  of 
Variance  by  Ranks,  is  used  in  order  to  determine  if  any  statistical  differences  occur 
between  variables  within  the  four  aforementioned  factors  (MAJCOM,  contract  function, 
contract  type,  and  award  year  of  contract).  The  Kruskal-Wallis  test  is  calculated  using  the 
STATISTIX®  software  package.  The  reason  for  using  the  Kruskal-Wallis  lies  in  two 
reasons:  (1)  the  data  for  all  variables  within  factors  do  not  have  normal  distributions, 
therefore  use  of  a  single  factor  between  subjects  analysis  of  variance  is  saliently  violated, 
and  (2)  the  variables  within  the  factors  are  independent  from  another.  Although,  the 
variables  do  not  have  homogeneity  of  distributions  as  required  by  the  rigorous 
employment  of  the  Kruskal-Wallis,  it  has  nevertheless  been  proved  with  empirical 
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evidence  that  this  condition  need  not  be  met  (Sheskin,  1997).  Tests  will  be  conducted  at 
the  0.05  and  0.10  level  of  significance. 

These  two  levels  of  significance  are  chosen  for  two  reasons.  One,  it  is  not  known 
whether  the  sample  of  data  in  this  analysis  is  a  truly  representative  sample.  If  this  data 
were  truly  representative  of  the  population,  a  level  of  significance  less  than  or  equal  to 
0.01  would  be  used.  On  the  other  hand,  this  research  is  not  exploratory  research  for 
which  a  level  of  significance  greater  than  or  equal  to  0. 15  would  be  used  (Roscoe,  1969). 
Therefore,  the  0.05  and  0. 10  levels  of  significance  used  in  this  research  can  be  viewed  as 
a  compromise  between  the  two  extremes  of  equal  or  less  than  0.01  and  greater  than  or 
equal  to  0.15. 

Due  to  the  fact  the  factor  contract  type  only  has  two  variables  (firm-fixed  price,  and 
other-than-firm-fixed  price),  the  Mann-Whitney  test  is  used  to  test  for  statistical 
differences  between  the  two  variables.  The  Mann-Whitney  test  is  computed  using  the 
STATISTIX®  software  package.  This  test  was  developed  before  the  Kruskal-Wallis  test 
and  in  fact  was  the  basis  for  the  development  of  the  Kruskal-Wallis  test  (where  the 
number  of  variables  are  greater  than  two)  (Roscoe,  1969).  Again,  tests  will  be  conducted 
at  the  0.05  and  0. 10  level  of  significance. 

Finally,  linear  regression  is  used  to  determine  if  a  statistical  inference  (trend)  can  be 
determined  concerning  the  factor  Award  Year  of  Contract.  Since  this  is  the  only  factor  in 
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time-series,  it  is  appropriate  to  determine  if  cost  growth  is  increasing,  decreasing,  or 
constant  with  time  (Devore,  1995).  The  unweighted  linear  regression  is  computed  using 
the  STATISTIX®  software  package. 
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IV.  Results 


Overview 

The  results  section  of  this  research  effort  focuses  on  the  presentation  of  results  from  the 
use  of  descriptive  statistics,  non-parametric  statistics,  and  linear  regression,  as  described 
in  the  methodology  section.  Throughout  this  research  values  for  the  median,  minimum, 
maximum,  inner-quartile  range,  mean,  and  standard  deviation,  as  well  as  all  values 
presented  unless  otherwise  indicated  are  presented  using  the  unit  percent  cost  growth  as 
calculated  in  equation  (3)  of  the  methodology  section.  First,  results  for  all  contracts  taken 
collectively  are  presented.  Next,  results  for  the  four  factors  (MAJCOM,  contract 
function,  contract  type,  and  award  year  of  contract)  are  presented. 

All  Contracts 

Table  1  represents  the  results  of  descriptive  statistics  as  described  in  the  methodology 
section  of  this  research.  There  is  a  great  variation  of  results  with  respect  to  percent  cost 
growth.  This  is  apparent  from  the  standard  deviation  value  of  37. 16.  In  addition,  the 
great  difference  between  the  minimum  (-29.5)  and  maximum  (310.69)  values  of  percent 
cost  growth  reiterate  the  substantial  variation  that  exists  with  respect  to  percent  cost 
growth.  Noteworthy,  is  the  difference  between  the  mean  value  of  14.02  and  the  median 
value  of  4.57,  which  would  indicate  a  non-normal  distribution  of  the  data. 
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Table  1  -  Descriptive  Statistics  for  All  Contracts 


All  Contracts 

Number  of  Observations 

124 

Mean 

14.02 

Standard  Deviation 

37.16 

Standard  Error  of  the  Mean 

3.34 

Minimum 

-29.51 

Median 

4.57 

Maximum 

310.69 

Inner-Quartile  Range 

14.26 

The  histogram  in  Figure  6  below  shows  the  distribution  of  percent  cost  growth.  It  is 
apparent  that  the  great  majority  of  values  fall  between  (-30)  and  50  percent  cost  growth. 
The  four  percent  cost  growth  bins  with  the  highest  frequencies,  [0-5],  [5-10],  [10-15],  and 
[15-20],  account  for  82  of  the  124  contracts,  or  just  over  2/3*^^®  of  the  contracts  analyzed. 
Noteworthy  is  the  fact  two  “spikes”  occur  in  the  [0,5],  and  [5,10]  bins.  These  two 
“spikes”  would  initially  indicate  a  non-normal  distribution;  however,  due  to  the  fact  the 
bins  are  in  5  percent  cost  growth  increments  it  cannot  be  concluded  that  this  is  a  non¬ 
normal  distribution.  In  addition,  the  values  located  in  the  [165,170]  and  [310,315]  bins 
would  appear  to  be  well  outside  grouping  of  the  remaining  data.  This  indicates  that  these 
two  values  could  possibly  be  considered  outliers;  however,  this  cannot  be  confirmed  from 
this  histogram  alone. 
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Figure  6  -  Histogram  of  Percent  Cost  Growth  for  All  Contracts 


Figure  7  is  a  box  and  whisker  plot  of  percent  cost  growth  for  all  contracts.  Extreme 
values  are  displayed  as  for  possible  outliers  and  "O"  for  probable  outliers.  Possible 
outliers  are  values  that  are  outside  the  box  boundaries  by  more  than  IV2  times  the  size  of 
the  box.  Probable  outliers  are  values  that  are  outside  the  box  boundaries  by  more  than  3 
times  the  size  of  the  box.  Although,  eight  values  appear  to  be  probable  outliers,  only  the 
two  values  greater  than  110  percent  cost  growth  appear  to  be  distinct  extreme  probable 
outliers.  For  this  reason,  they  shall  be  removed  from  the  analysis.  Although  the  other  six 
probable  outliers  can  be  removed  from  the  analysis,  the  fact  that  there  are  six  and  the  fact 
they  are  basically  evenly  spread  from  the  possible  outliers  validates  their  inclusion  in 
further  analysis.  This  is  the  judgement  of  the  author.  (Note:  The  entire  analysis  in  this 
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research  was  run  with  their  inclusion,  and  produced  no  different  results  with  respect  to 
the  statistical  differences  between  variables  within  the  four  factors.  It  is  the  author’s 
judgment  that  these  two  cases  were  extreme  examples  of  cost  growth  that  would  not  be 
the  result  of  typical  causes  of  cost  growth  considering  the  rest  of  the  data.). 


Box  and  Whisker  Plot  of  %  Cost  Growth 


Figure  7  -  Box  and  Whisker  Plot  of  Percent  Cost  Growth 


Table  2  represents  a  revised  analysis  without  the  two  extreme  probable  outliers.  The 
mean  and  standard  deviation  are  effected  greatly.  The  mean  decreases  from  14.02  to 
10.31  and  the  standard  deviation  decreases  from  37.16  to  21.51.  In  addition,  the  standard 
error  of  the  mean  falls  from  3.34  to  1.95.  It  is  apparent  the  two  extreme  probable  outliers 
had  profound  effect  due  to  the  relatively  small  sample  size  of  this  data.  The  median  value 
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remains  changes  little  to  4.56.  The  difference  between  the  mean  and  median  values  still 
indicates  a  non-normal  distribution. 


Table  2  -  Revised  Descriptive  Statistics  without  Extreme  Probable  Outliers 


All  Contracts 

Number  of  Observations 

122 

Mean 

10.31 

Standard  Deviation 

21.51 

Standard  Error  of  the  Mean 

1.95 

Minimum 

-29.51 

Median 

4.56 

Maximum 

109.97 

Inner-Quartile  Range 

13.625 

ExpertFit®  is  used  to  determine  the  distribution  for  which  the  data  is  representative. 
Initially,  the  122  cases  were  entered  and  produced  “borderline  representations”  and  “bad 
representations”  regarding  the  particular  distributions  ExpertFit®  characterized  as  most 
representative  of  the  data  (see  methodology  section  for  explanation  of  ExpertFit® 
representations).  This  was  confirmed  using  frequency-comparison-overlay  plots  of  the 
data  compared  to  the  actual  distributions  as  recommended  by  ExpertFit®.  It  was  noted 
during  evaluation  of  the  frequency-comparison-overlay  plots  that  a  “spike”  occurred  at 
the  0.00  value  of  percent  cost  growth.  This  “spike”  was  caused  by  the  fact  1  l(or  9.02%) 
of  the  122  cases  are  exactly  0.00.  Since  it  is  likely  many  contracts  will  have  0.00  percent 
cost  growth,  there  is  a  point  mass  of  probability  at  0.00  percent  cost  growth  to  go  with  the 
rest  of  the  probability  density  distributed  on  the  real  line.  This  means  we  really  have  a 
mixture  distribution  of  a  discrete  part  and  a  continuous  part  of  the  distribution.  If  we 
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exclude  the  point  mass  discrete  part  from  the  data  we  can  try  to  fit  a  distribution  to  the 
remaining  continuous  part. 

In  order  to  attempt  to  fit  the  data  within  a  continuous  distribution,  ExpertFit®  was  run 
without  the  eleven  0.00  values.  ExpertFit  ®  produced  one  “good  representation”  with 
respect  to  the  Johnsonsu  distribution.  The  Johnsonsu  distribution  can  be  most  compared 
to  a  Normal  distribution;  however,  it  has  a  much  narrower  peak  and  accounts  for  greater 
variation  at  or  near  the  tails  (Miller,  1995:  481). 

Figure  8  represents  a  probability  density  function  for  the  Johnsonsu  distribution  of  the 
data  for  percent  cost  growth  taking  into  account  that  the  0.00  values  (which  compose 
9.02%  of  the  data)  are  removed.  Noteworthy  is  the  fact  the  distribution  appears  to  be  a 
“normal-like”  distribution  with  a  steep  peak  and  centered  at  approximately  10  percent  cost 
growth.  In  addition,  examination  of  the  curve  reveals  non-symmetry.  This  is  confirmed 
by  comparing  the  values  -10  and  30  percent  cost  growth  (both  values  are  equal  units  on 
the  chart  from  the  apparent  center  of  the  distribution).  The  probability  for  -10  percent 
cost  growth  is  approximately  0.04  while  for  30  percent  cost  growth  the  value  is  0.07. 

This  is  true  for  all  corresponding  values  near  the  ends  of  the  distribution.  This  confirms 
the  non-symmetry  of  the  distribution  as  well  as  indicating  the  larger  probability  of 
positive  cost  growth  values. 
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Probability  Density  Function  for  Johnsonsu  Distribution 
of  Percent  Cost  Growth 
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Figure  8  -  Probability  Density  Function 


Figure  9  is  a  cumulative  density  function  (CDF)  for  the  Johnsonsu  distribution  of  percent 
cost  growth  also  without  the  eleven  0.00  values  (apparent  from  the  fact  the  CDF  line  only 
approaches  0.90.  From  this  figure  it  is  clear  that  the  vast  majority  of  percent  cost  growth 
values  are  greater  than  zero.  In  fact  from  the  figure  it  is  easy  to  approximate  that  7%  of 
the  values  are  negative.  From  this  it  can  be  concluded  that  84%  of  all  values  are  positive 
(100%  minus  7%  for  negative  cost  growth  minus  9%  for  no  cost  growth).  It  can  be 
concluded  from  this  that  the  great  majority  of  US  AF  base  support  function  contracts 
awarded  between  1986  -  1994  have  experienced  cost  growth  (84%  positive  and  7% 
negative).  It  could  be  stated  that  this  confirms,  among  other  possibilities,  the  inability  of 
the  USAF  to  consistently  construct  adequate  statements  of  work  considering  the  findings 
of  the  GAO,  AFAA,  and  DOD IG  audits/reports. 
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Cummulative  Density  Function  for  Johnsonsu 
Distribution  of  Percent  Cost  Growth 
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Figure  9  -  Cumulative  Density  Function 


Factors 

The  results  for  the  four  factors  (MAJCOM,  contract  function,  contract  type,  and  award 
year  of  contract)  are  presented  in  the  following  format: 

1. )  Results  of  descriptive  statistics  and  discussion 

2. )  Presentation  of  mean  and  standard  deviation  rank  table  and  discussion 

3. )  Results  of  the  Kruskal- Wallis  test  and  discussion 

4. )  Results  of  linear  regression  (for  the  factor  -  award  year  of  contract  only) 


FACTOR  1  -  MAJCOM 


Table  3  represents  the  results  of  descriptive  statistics  as  described  in  the  methodology 
section  of  this  research  for  the  factor  MAJCOM.  All  variables  within  the  factor 
MAJCOM  have  non-normal  distributions;  therefore,  the  median  and  inner-quartile  range 
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values  will  be  used  to  compare  variables.  The  median  value  of  percent  cost  growth  varies 
from  a  low  of  3.72  for  AFMC  to  a  high  of  10.98  for  AFSPC.  This  compares  to  a  median 
value  of  percent  cost  growth  for  all  contracts  collectively  of  4.56.  The  inner-quartile 
range  varies  from  a  low  of  7.71  for  AFMC  to  a  high  of  28.88  for  AMC.  This  compares  to 
an  inner-quartile  range  value  of  13.625  for  all  contracts  taken  collectively.  There  appears 
to  be  a  disparity  between  the  MAJCOMs.  This  research  will  first  address  the  relative 
differences  (using  a  median  and  inner-quartile  range  rank  table  and  a  median  with  inner- 
quartile  range  figure)  and  then  the  statistical  differences  (using  the  Kruskal-Wallis  test) 
between  the  MAJCOMs. 


Table  3  -  Descriptive  Statistics  for  Contracts  by  MAJCOM 


MAJCOM 

Number  of 

Observations 

Median 

Min 

Max 

Inner- 

Quartile 

Range 

Mean 

Standard 

Deviation 

ACC 

33 

4.58 

-22.68 

109.97 

17.48 

12.73 

24.79 

AETC 

24 

4.48 

-11.05 

99.30 

9.79 

10.33 

21.57 

AFMC 

36 

3.72 

-29.51 

101.32 

7.71 

8.21 

23.14 

AFSPC 

21 

10.98 

-24.56 

33.62 

12.62 

8.64 

14.55 

AMC 

8 

7.68 

0.00 

45.82 

28.88 

14.15 

17.46 

To  further  explore  the  relative  differences  between  variables  within  the  factor  MAJCOM, 
Table  4  represents  the  median  and  inner-quartile  range  ranks  for  the  variables  within  the 
factor  MAJCOM.  AFMC  appears  dominant  (i.e.,  having  the  lowest  median  and  inner- 
quartile  range  ranks)  followed  by  AETC.  This  indicates  that  AFMC  and  AETC  when 
compared  to  the  other  MAJCOMs  not  only  has  a  relatively  lower  percent  cost  growth,  but 
also  that  their  percent  cost  growth  values  are  not  as  widely  distributed.  AFSPC  and  AMC 
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appear  to  have  relatively  high  median  and  inner-quartile  range  ranks  when  compared  to 
the  other  MAJCOMs.  Meaning,  their  percent  cost  growth  values  are  not  only  higher  but 
also  more  widely  distributed. 


Table  4  -  Median  and  Inner-Quartile  Range  Rank  Table  for  Contracts 


MAJCOM 

Median  Rank 

Inner-Quartile  Range 
Rank 

ACC 

3 

4 

AETC 

2 

2 

AFMC 

1 

1 

AFSPC 

5 

4 

AMC 

4 

5 

Figure  10  reflects  the  median  with  inner-quartile  range  for  all  contracts  by  MAJCOM. 
Noteworthy  from  the  figure  is  the  fact  the  inner-quartile  ranges  overlap  for  all  of  the 
variables,  initially  indicating  that  there  is  no  statistical  difference  between  the  variables 
within  the  factor  MAJCOM.  Thus  the  level  of  cost  growth  that  occurs  in  one  MAJCOM 
may  not  be  statistically  different  from  the  level  of  cost  growth  in  the  other  MAJCOMs. 
However,  this  statistical  difference  can  only  be  shown  with  a  statistical  test  conducted 
over  a  level  of  significance.  This  research  will  test  for  statistical  differences  between  the 
variables  within  the  factor  MAJCOM  with  the  Kruskal-Wallis  test.  Of  note  is  the  fact  the 
mean  values  appearing  higher  than  the  median  values  in  all  but  AFSPC.  This  would 
indicate  the  presence  of  high-value  outliers,  which  significantly  affect  the  mean  value. 
The  large  inner-quartile  range  in  AMC  is  likely  due  to  the  relatively  small  sample  size 
and  the  presence  of  high-value  outliers.  AFSPC,  due  to  the  fact  the  mean  value  is  lower 
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than  the  median  value,  would  appear  to  have  a  number  of  relatively  lower  percent  cost 
growth  values. 


Table  5  represents  the  results  for  the  Kruskal-Wallis  test  for  statistical  differences 
between  the  variables  within  the  factor  MAJCOM.  The  results  of  the  Kruskal-Wallis  test, 
at  0.05  significance  level,  indicate  that  no  significant  pairwise  statistical  difference  among 
the  means  exist.  An  additional  test  at  significance  level  =  0.10  was  run  with  the  same 
results.  This  confirms,  from  Figure  10  and  previous  results,  that  the  variables  within  the 
factor  MAJCOM,  while  relatively  different  from  one  another,  are  not  statistically 
different,  at  the  0.05  or  0. 10  level,  from  one  another. 
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Table  5  -  Results  for  Kruskal-Wallis  Test  for  Contracts  by  MAJCOM 


Kruskal-Wallis  Test  for  MAJCOM 


Variable 

Mean 

Rank 

Sample  Size 

Homogeneous 

Groups 

AFSPC 

72.048 

21 

I 

AMC 

65.875 

23 

I 

ACC 

62.424 

33 

I 

AETC 

61.604 

24 

I 

AFMC 

53.458 

36 

I 

TOTAL 

61.5 

122 

Rejection  Level  =  .05 

Total  Number  of  Values  that  were  Tied  =17 
Maximum  Difference  Allowed  Between  Ties  =  .00001 


In  summary  regarding  the  factor  MAJCOM,  the  following  can  be  concluded.  Relative 
differences  between  MAJCOMs  with  respect  to  the  amount  of  cost  growth  that  occurred 
in  USAF  base  support  function  contracts  awarded  between  1986  -  1994  do  exist.  This  is 
clear  from  Figure  10.  However,  due  to  the  overlap  of  the  inner-quartile  ranges  for  each 
variable’s  percent  cost  growth,  no  statistical  differences  can  be  found  (at  the  .05  or  .10 
level  of  significance)  between  the  MAJCOMs  with  respect  to  the  amount  of  cost  growth. 
In  other  words,  no  MAJCOM  is  meaningfully  any  different  from  any  other  with  respect  to 
the  amount  of  cost  growth  of  their  respective  contracts. 

FACTOR  2  -  CONTRACT  FUNCTION 

Table  6  represents  the  results  of  descriptive  statistics  as  described  in  the  methodology 
section  of  this  research  for  the  factor  contract  function.  All  variables  within  the  factor 
MAJCOM  have  non-normal  distributions;  therefore,  the  median  and  inner-quartile  range 
values  will  be  used  to  compare  variables.  The  median  value  of  percent  cost  growth  varies 
from  a  low  of  0.75  for  Other  Contract  Functions  to  a  high  of  19.05  for  Military  Family 
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Housing.  This  compares  to  a  median  value  of  percent  cost  growth  for  all  contracts  taken 
collectively  of  4.56.  The  inner-quartile  range  varies  from  a  low  of  6.60  for  Other 
Contract  Functions  to  a  high  of  80.04  for  Protective  Coatings,  compared  to  an  inner- 
quartile  range  value  of  13.625  for  all  contracts  taken  collectively.  There  appears  a  great 
disparity  between  the  contract  functions.  This  research  will  first  address  the  relative 
differences  (using  a  median  and  inner-quartile  rank  table  and  a  median  and  inner-quartile 
range  figure)  and  then  the  statistical  differences  (using  the  Kruskal -Wallis  test)  between 
the  contract  functions. 
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Table  6  -  Descriptive  Statistics  for  Contracts  by  Contract  Function 


Contract  Function 

Number  of 

Observations 

Median 

Min 

Max 

Inner- 

Quartile 

Range 

Mean 

Standard 

Deviation 

Furnishings  Management 
(FM) 

4 

16.35 

1.94 

99.30 

73.81 

33.48 

44.42 

Military  Family  Housing 
(MFH) 

9 

19.05 

0.59 

66.10 

34.70 

20.88 

22.04 

Postal  Service  (PS) 

14 

5.67 

-6.07 

44.58 

24.30 

11,69 

15.66 

10 

4.99 

0.65 

101.32 

6.90 

14.07 

30.80 

Grounds  Maintenance 
(GM) 

15 

4.56 

-15.99 

29.61 

13.82 

6.26 

13.30 

Protective  Coatings  (PC) 

7 

6.28 

0.00 

109.97 

80.04 

34,87 

44.96 

Janitorial  Services  (JAN) 

18 

7.28 

-29.51 

57.64 

12.49 

7.67 

18.51 

Information  Management 
(INFO) 

9 

2.24 

-24.56 

17.82 

11.70 

0.30 

12.00 

Logistics  (LOG) 

12 

9.87 

0.00 

26.27 

11.99 

10.28 

7.41 

Switchboard  Operations 
(SWITCH) 

4 

2.68 

-15.21 

4.56 

15.70 

-1.33 

9.41 

Other  Contract  Functions 
(OTHER) 

20 

0.75 

-13.97 

19.69 

6.60 

1.75 

7.94 

To  further  explore  the  relative  differences  between  variables  within  the  factor  contract 
function,  Table  7  represents  the  median  and  inner-quartile  range  ranks  for  the  variables 
within  the  factor  contract  function.  Other  Contract  Functions  [1,1]  appears  dominant  (i.e. 
having  the  lowest  median  and  inner-quartile  range  ranks).  This  indicates  that  Other 
Contract  Functions  when  compared  to  the  other  contract  functions  has  a  relatively  lower 
percent  cost  growth  value,  and  its  percent  cost  growth  values  are  not  as  widely 
distributed.  Information  Management  [2,3]  appears  to  be  the  only  other  contract  function 
with  relatively  lower  median  and  inner-quartile  range  values.  Clearly,  Military  Family 
Housing  [1 1,9]  and  Furnishings  Management  [10,10]  have  relatively  higher  median  and 
inner-quartile  range  ranks  among  the  contract  functions.  This  indicates  that  Military 
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Family  Housing  and  Furnishings  Management  when  compared  to  the  other  contract 
functions  have  a  relatively  higher  percent  cost  growth  value,  and  that  their  percent  cost 
growth  values  are  more  widely  distributed. 


Table  7  -  Median  and  Inner-Quartile  Range  ] 

?^ank 

Contract  Function 

Median  Rank 

Inner-Quartile  Range 
Rank 

Furnishing  Management 

10 

10 

Military  Family  Housing 

11 

9 

Postal  Service 

6 

8 

Transient  Aircraft  Maintenance 

5 

2 

Grounds  Maintenance 

4 

6 

Protective  Coatings 

7 

11 

Janitorial  Services 

8 

5 

Information  Management 

2 

3 

Logistics 

9 

4 

Switchboard  Operations 

3 

7 

Other  Contract  Functions 

1 

1 

Figure  1 1  reflects  the  median  and  inner-quartile  for  all  contracts  by  contract  function. 
Noteworthy  from  the  figure  is  the  fact  that  the  inner-quartile  ranges  have  eonsiderable 
overlap,  initially  indicating  that  there  is  no  statistical  difference  between  the  variables 
within  the  factor  contract  function.  Thus  the  level  of  cost  growth  that  occurs  in  one  or 
more  contract  functions  may  not  be  statistically  different  from  the  level  of  cost  growth  in 
the  other  contract  functions.  However,  this  statistical  difference  can  only  be  proven  with 
a  statistical  test  conducted  over  a  level  of  significance.  This  research  will  test  for 
statistical  differences  between  the  variables  within  the  factor  contract  function  with  the 
Kruskal-Wallis  test.  The  large  inner-quartile  range  in  Furnishing  Management  and 
Protective  Coatings  is  likely  a  result  of  small  sample  sizes  with  the  presence  of  high 
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percent  cost  growth  values.  As  with  the  variables  with  the  factor  MAJCOM  the  presence 
of  mean  values  larger  than  median  values  in  a  number  of  variables  indicates  not  only  a 
non-normal  distribution,  but  also  the  presence  of  higher-valued  outliers  within  the 
variables’  distribution. 


MEDIAN  with  Inner-Quartile  Range 


Median 

Mean 


Contract  Function  (Sample  Size) 


Figure  1 1  -  Percent  Cost  Growth  of  Contracts  by  Contract  Function 


Table  8  represents  the  results  for  the  Kruskal -Wallis  test  for  statistical  differences 
between  the  variables  within  the  factor  contract  function.  The  results  of  the  Kruskal- 
Wallis  test,  at  0.05  significance  level,  indicate  that  no  significant  pairwise  difference 
among  the  means  exist.  An  additional  test  at  significance  level  =  0.10  was  run  with  the 
same  results.  This  confirms  from  Figure  1 1  and  previous  results,  that  the  variables  within 
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the  factor  contract  function,  while  relatively  different  from  one  another,  are  not 
statistically  different,  at  the  0.05  or  0.10  level,  from  one  another.  Therefore,  it  can  be 
concluded  that  there  is  no  difference  between  contract  functions  with  respect  to  amount  of 
percent  cost  that  occurred  in  USAF  base  support  function  contracts  awarded  between 
1986-1994. 


Table  8  -  Results  for  Kruskal-Wallis  Test  for  Contracts  for  Contract  Function 


Kruskal-Wallis  Test  for  Contract  Function 


Variable 

Mean 

Rank 

Sample 

Size 

Homogeneous 

Groups 

Furnishing  Management  (FM) 

89.8 

4 

I 

Grounds  Maintenance  (GM) 

59.1 

15 

I 

Information  Management  (INFO) 

46.6 

9 

I 

Janitorial  Services  (JAN) 

63.7 

18 

I 

Logistics  (LOG) 

76.2 

12 

I 

Military  Family  Housing  (MFH) 

81.9 

9 

I 

Other  Contract  Functions  (OTHER) 

41.5 

20 

I 

Protective  Coatings  (PC) 

74.4 

7 

I 

Postal  Service  (PS) 

63.4 

14 

I 

Switchboard  Operations  (SWITCH) 

4 

I 

Transient  Aircraft  Maintenance  (TAM) 

64.2 

10 

I 

TOTAL 

61.5 

122 

Rejection  Level  =  .05 

Total  Number  of  Values  that  were  Tied  =  17 
Maximum  Difference  Allowed  Between  Ties  =  .00001 


In  summary  regarding  the  factor  contract  function,  the  following  can  be  concluded. 
Relative  differences  between  variables  with  respect  to  the  amount  of  cost  growth  that 
occurred  in  USAF  base  support  function  contracts  awarded  between  1986  -  1994  does 
exist.  However,  due  to  the  extensive  overlap  of  inner-quartile  ranges  between  variables, 
no  statistical  differences  can  be  found  (at  the  0.05  or  0.10  level  of  significance)  between 
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the  variables  with  respect  to  the  amount  of  cost  growth.  In  other  words,  no  contract 
function  (variable)  is  meaningfully  different  from  any  other  contract  function  with  respect 
to  the  amount  of  cost  growth  of  their  respective  contracts. 

FACTOR  3  -  CONTRACT  TYPE 

Table  9  represents  the  results  of  descriptive  statistics  as  described  in  the  methodology 
section  of  this  research  for  the  factor  contract  type.  All  variables  within  the  factor 
Contract  Type  have  non-normal  distributions;  therefore,  the  median  and  inner-quartile 
range  values  will  be  used  to  compare  variables.  There  appears  a  noticeable  difference 
between  the  two  contract  types.  Other-than-  FFP’s  median  value  of  percent  cost  growth 
is  close  to  double  Firm  Fixed  Price’s.  The  difference  between  their  inner-quartile  ranges 
is  even  more  pronounced  considering  Firm  Fixed  Price’s  inner-quartile  range  is  1 1.15  and 
Other  than  Firm-Fixed  Price’s  inner-quartile  range  is  21. 16,  a  difference  of  greater  than 
10.0  percentage  points. 


Table  9  -  Descriptive  Statistics 


or  Contracts  by  Contract  Type 


Contract  Type 

Number  of 
Observations 

Median 

Min 

Max 

Inner- 

Quartile 

Range 

Mean 

Standard 

Deviation 

Firm-Fixed  Price 

89 

4.29 

-29.51 

101.32 

11.15 

7.92 

18.86 

Other-than-Firm-Fixed 

Price 

33 

7.34 

-15.99 

109.97 

21.16 

16.76 

16.70 

Figure  12  reflects  the  median  with  inner-quartile  range  for  all  contracts  by  contract  type. 
Again,  there  is  considerable  overlap  between  the  inner-quartile  ranges  for  each  of  the 
contract  types.  This  overlap  of  standard  deviations  initially  would  indicate  that  there  is 
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no  statistical  difference  between  the  two  contract  types.  However,  this  statistical 
difference  can  only  be  shown  with  a  statistical  test  conducted  over  a  level  of  significance. 
This  research  will  test  for  statistical  differences  between  the  variables  within  the  factor 
contract  type  with  the  Mann-Whitney  test.  Even  more  significant  is  Other-than-Firm- 
Fixed  Price’s  difference  between  median  and  mean  value.  This  difference  indicates  the 
presence  of  a  considerable  number  of  high-percent,  cost-growth  values.  The  difference 
between  Firm-Fixed  Price’s  median  and  mean  values  is  not  as  pronounced;  however,  it  as 
well  indicates  the  presence  of  high-percent,  cost-growth  values. 


MEDIAN  with  Inner-Quartile  Range 


•Median 


O  Mean 


Figure  12  -  Percent  Cost  Growth  of  Contracts  by  Contract  Type 


The  factor  contract  t)^e  only  has  two  variables,  due  to  this  and  as  described  in  the 
methodology  section  of  this  research  the  Mann-Whitney  test  will  be  conducted.  Table  10 
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represents  the  results  for  the  Mann-Whitney  test  for  statistical  differences  between  the 
variables  with  the  factor  contract  type.  The  U-Stat  for  this  particular  test  is  1 156.  No  U- 
charts  could  be  obtained  for  the  particular  sample  sizes;  therefore,  the  z-value  must  be 
used  using  the  normal  approximation.  The  z-value  for  this  particular  test  is  z  =  -1.801. 
(See  Appendix  B  for  calculation  of  z-value)  The  critical  value  is  -1.96  <  <  1.96. 

Since  z  =  -1.801  falls  between  -1.96  <  <  1.96,  for  a  two-tailed  test  at  the  .05 

significance  level,  this  indicates  that  the  two  variables  are  not  significantly  different  from 
one  another  (Roscoe,  1969).  However,  the  Mann-Whitney  test  conducted  at  a 
significance  level  =  0.10  showed  the  variables  to  be  statistically  different  from  one 
another.  In  other  words,  when  the  rejection  level  was  increased  from  0.05  to  0. 10  there  is 
now  a  10%  probability  that  the  null  hypothesis  (there  is  no  statistical  difference  between 
the  variables)  has  been  falsely  rejected  when  in  fact  it  is  true.  This  is  significant,  due  to 
the  fact  that  depending  upon  the  validity  (how  representative  of  a  sample)  of  the  data,  cost 
growth  may  or  may  not  be  the  result  of  the  type  of  contract. 
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Table  10  -  Results  for  Mann-Whitney  Test  for  Contracts  for  Contract  Type 


Mann-Whitney  Test  for  Contract  Type 


Variable 

Rank  Sum 

Sample  Size 

UStat 

Firm  Fixed  Price 
(FFP) 

5161.00 

89 

1156 

Other  than  Firm 
Fixed  Price 
(OTHERTYPE) 

2342.0 

33 

1781 

TOTAL 

7503 

122 

Total  Number  of  Values  that  were  Tied  =  17 
Maximum  Difference  Allowed  Between  Ties  =  .00001 


FACTOR  4  -  AWARD  YEAR  OF  CONTRACT 

Table  1 1  represents  the  results  of  descriptive  statistics  as  described  in  the  methodology 
section  of  this  research  for  the  factor  award  year  of  contract.  All  variables  within  the 
factor  Award  Year  of  Contract  have  non-normal  distributions;  therefore,  the  median  and 
inner-quartile  range  values  will  be  used  to  compare  variables.  The  median  value  of 
percent  cost  growth  varies  from  a  low  of  1.37  for  1990  to  a  high  of  7.04  for  1992.  This 
compares  to  a  median  value  of  percent  cost  growth  for  all  contracts  taken  collectively  of 
4.56.  The  inner-quartile  range  varies  from  a  low  of  7.20  for  1986  to  a  high  of  40.65  for 
1988,  compared  to  a  inner-quartile  range  of  13.63  for  all  contracts  taken  collectively. 
There  appears  to  be  a  disparity  between  the  award  years  of  contracts.  This  research  will 
first  address  the  relative  differences  (using  a  median  and  inner-quartile  range  rank  table 
and  a  median  and  inner-quartile  range  figure),  then  the  statistical  differences  (using  the 
Kruskal-Wallis  test)  between  the  award  years  of  contracts,  and  linear  regression  to  assess 
correlation  between  year  and  percent  cost  growth. 


51 


Table  1 1  -  Descriptive  Statistics  for  Contracts  by  Award  Year  of  Contract 


Award 

Year  of 

Contract 

Number  of 
Observations 

Median 

Min 

Max 

Inner- 

Quartile 

Range 

Mean 

Standard 

Deviation 

1986 

5 

3.88 

0.00 

11;58 

7.20 

4.72 

4.33 

1987 

7 

4.50 

-15.21 

14.64 

11.89 

3.04 

9.67 

1988 

5 

4.29 

-13.97 

45.82 

40.65 

11.91 

22.96 

1989 

8 

4.27 

-15.99 

109.97 

15.12 

13.57 

39.88 

1990 

14 

1.37 

-1.62 

31.76 

8.06 

5.88 

9.35 

1991 

16 

2.72 

-22.68 

44.58 

16.65 

8.00 

16.73 

1992 

20 

7.04 

-29.51 

101.32 

14.85 

11.17 

24.25 

1993 

27 

6.28 

-8.69 

99.30 

18.55 

14.25 

22.77 

1994 

20 

4.49 

-24.56 

80.04 

19.88 

11.33 

23.73 

To  further  explore  the  relative  differences  between  variables  within  the  factor  award  year 
of  contract,  Table  12  represents  the  median  and  inner-quartile  range  ranks  for  the 
variables  within  the  factor  award  year  of  contract.  No  award  year  of  contract  dominates; 
however,  1986  [3,1],  and  1990  [1,2],  appear  to  have  relatively  lower  median  and  inner- 
quartile  range  ranks  among  award  years  of  contract.  This  indicates  contracts  awarded  in 
1986,  and  1990  when  compared  to  contracts  awarded  in  other  years  have  a  relatively 
lower  percent  cost  growth  value,  and  their  percent  cost  growth  values  are  not  as  widely 
distributed.  Only,  1993  [8,7]  stands  out  from  the  other  contracts  as  having  both  a  high 
median  and  inner-quartile  range  rank  among  the  award  years  of  contract.  This  indicates 
that  contracts  awarded  in  1993  when  compared  to  other  contracts  awarded  in  other  years 
has  a  relatively  higher  percent  cost  growth  value,  and  its  percent  cost  growth  value  is 
more  widely  distributed 
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Table  12 -M 

[edian  and  Inner-Quartile  Range  Rank  Table 

Award  Year  of  Contract 

Median  Rank 

Inner-Quartile  Range 
Rank 

1986 

3 

1 

1987  ^ 

7 

3 

1988 

5 

9 

1989 

4 

5 

1990 

1 

2 

1991 

2 

6 

1992 

9 

4 

1993 

8  n 

7 

1994 

6 

8 

Figure  13  reflects  the  median  with  inner-quartile  range  for  all  contracts  by  award  year  of 
contract.  Noteworthy  from  the  figure  is  the  fact  that  the  considerable  overlap  of  the 
inner-quartile  ranges  for  all  of  the  variables,  initially  indicating  that  there  is  no  statistical 
difference  between  the  variables  within  the  factor  award  year  of  contract.  Meaning  the 
level  of  cost  growth  that  occurs  in  one  or  more  award  years  of  contacts  may  not  be 
statistically  different  from  the  level  of  cost  growth  in  the  other  award  years  of  contacts. 
However,  this  statistical  difference  can  only  be  shown  with  a  statistical  test  conducted 
over  a  level  of  significance.  This  research  will  test  for  statistical  differences  between  the 
variables  within  the  factor  award  year  of  contract  using  the  Kruskal-Wallis  test.  The  year 
1988  has  an  unusually  large  inner-quartile  range.  This  is  likely  the  result  of  a  small 
sample  size  coupled  with  the  presence  of  one  or  two  high  values  of  percent  cost  growth. 
In  addition,  the  repetitive  pattern  from  1991  to  1994  is  significant.  This  would  initially 
indicate  almost  a  stabilization  of  the  inner-quartile  range  coupled  with  the  presence  of 
high  values  in  each  of  the  years  that  cause  the  mean  to  be  higher  than  the  median  values 
in  all  of  those  variables. 
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Figure  13  -  Percent  Cost  Growth  of  Contracts  by  Award  Year  of  Contract 


Table  13  represents  the  results  for  the  Kruskal-Wallis  test  for  statistical  differences 
between  the  variables,  at  0.05  significance  level,  within  the  factor  award  year  of  contract. 
The  results  of  the  Kruskal-Wallis  test  indicate  that  no  significant  pairwise  statistical 
differences  among  the  means  exist  (i.e.,  no  two  variable  means  are  statistically  different). 
An  additional  test  at  significance  level  =  0. 10  was  run  with  the  same  results.  This 
confirms,  from  Figure  13  and  previous  results,  that  the  variables  within  the  factor  award 
year  of  contract,  while  relatively  different  from  one  another,  are  not  statistically  different, 
at  the  0.05  or  0.10  significance  level,  from  one  another.  Therefore,  it  can  be  concluded 
that  there  is  no  meaningful  difference  between  the  variables  with  the  factor  award  year  of 
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contract  with  respect  to  amount  of  percent  cost  that  occurred  in  USAF  base  support 
function  contracts  in  the  years  1986  -1994. 


Table  13  -  Results  for  Kruskal-Wallis  Test  for  Contracts  by  Award  Year  of  Contract 


Kruskal-Wallis  Test  for  Award  Year  of  Contract 


Variable 

Mean 

Rank 

Sample  Size 

Homogeneous 

Groups 

1986 

56.3 

5 

I 

1987 

54.6 

7 

I 

1988 

64.0 

5 

I 

1989 

54.6 

8 

I 

1990 

53.2 

14 

I 

1991 

59.6 

16 

I 

1992 

66.3 

20 

I 

1993 

67.9 

27 

I 

1994 

61.3 

20 

I 

TOTAL 

61.5 

122 

Rejection  Level  =  .05 

Total  Number  of  Values  that  were  Tied  =  17 
Maximum  Difference  Allowed  Between  Ties  =  .00001 


Due  to  the  fact  the  factor  award  year  of  contract  is  the  only  time-series  type  data,  this 
portion  of  the  results  focuses  on  the  use  of  linear  regression  on  the  factor  of  Award  Year 
of  Contract.  All  contracts  were  awarded  between  the  years  of  1986-1994.  Linear 
regression  will  determine  if  cost  growth  is  increasing,  decreasing,  or  remaining  constant 
during  the  time  period  in  question.  The  results  of  an  unweighted  linear  regression  for  all 
the  values  of  percent  cost  growth  follow  in  Figure  14  and  Table  14.  As  one  can  see  from 
the  plot,  it  appears  cost  growth  is  increasing  over  time.  However,  the  P-value  of  0.2506 
indicates  little  regression  effect.  In  this  case,  the  value  of  0.2506,  indicates  that  the  , 
regression  line  is  not  significantly  different  than  zero.  In  other  words,  although  the 
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regression  line  in  the  plot  appears  to  be  increasing  over  time,  in  reality  its  slope  is  not 
meaningfully  different  than  a  line  with  a  slope  of  zero. 


Regression  Plot  of  Year  &  %  Cost  Growth 


Figure  14  -  Linear  Regression  Plot  of  Percent  Cost  Growth  (All  Values) 
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Table  14  -  Results  of  Linear  Regression  (All  Values) 


LEAST  SQUARES  LINEAR  REGRESSION  OF  ALL  VALUES  OF  PERCENT  COST 

GROWTH 

PREDICTOR 

VARIABLES 

COEFFICIENT  STD  ERROR  STUDENT'S  T 

P 

CONSTANT 

-1964.62  1710.75  -1.15 

0.2531 

YEAR 

0.99178  0.85911  1.15 

0.2506 

R-SQUARED 

0.01 10  RESID.  MEAN  SQUARE  (MSE) 

461.576 

ADJUSTED  R-SQUARED  0.0027  STANDARD  DEVIATION 

21.4843 

SOURCE 

DF  SS  MS  F  P 

REGRESSION 

1  615.143  615.143  1.33  0.2506 

RESIDUAL 

120  55389.2  461.576 

TOTAL 

121  56004.3 

To  further  emphasis  the  previous  results,  Figure  15  and  Table  15  reflect  the  results  of  a 
linear  regression  of  the  median  values  of  percent  cost  growth  over  the  years  1986-1994. 

As  one  can  see  from  the  plot,  it  appears  cost  growth  is  also  increasing  over  time. 

However,  the  P-value  of  0.41 10  indicates  little  regression  effect.  In  this  case,  the  value  of 
0.41 10,  indicates  that  the  regression  line  is  not  significantly  different  than  zero.  In  other 
words,  although  the  regression  line  in  the  plot  appears  to  be  increasing  over  time,  in 
reality  its  slope  is  not  meaningfully  different  than  a  line  with  a  slope  of  zero.  This  further 
confirms  the  fact  that  it  cannot  be  determined  whether  cost  growth  is  increasing  or 
decreasing  over  time. 
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Figure  15  -  Linear  Regression  Plot  of  Percent  Cost  Growth  (Median  Values) 


_ Table  15  -  Results  of  Linear  Regression  (Median  Values) _ 

LEAST  SQUARES  LINEAR  REGRESSION  OF  MEDIAN  VALUES  OF  PERCENT 
COST  GROWTH 

PREDICTOR 

VARIABLES  COEFFICIENT  STD  ERROR  STUDENT'S  T  P 
CONSTANT  -384.067  439.364  -0.87  0.4110 

YEAR  0.19517  0.22079  0.88  0.4061 

R-SQUARED  0.1004  RESID.  MEAN  SQUARE  (MSE)  2.92479 
ADJUSTED  R-SQUARED  -0.028 1  STANDARD  DEVIATION  1 .71020 

SOURCE  DF  SS  MS  F  P 

REGRESSION  1  2.28540  2.28540  0.78  0.4061 
RESIDUAL  7  20.4735  2.92479 

TOTAL  8  22.7589 
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In  summary  regarding  the  factor  award  year  of  contract,  the  following  can  be  concluded. 
Relative  differences  between  variables  with  respect  to  the  amount  of  cost  growth  that 
occurred  in  USAF  base  support  function  contracts  awarded  between  1986  -  1994  does 
exist.  However,  due  to  the  variation  that  exists  for  each  variable’s  percent  cost  growth, 
no  statistical  differences  exist  between  the  variables  with  respect  to  the  amount  of  cost 
growth  that  occurred.  In  other  words,  no  award  year  (variable)  was  meaningfully 
different  than  the  other  award  years  with  respect  to  the  amount  of  cost  growth  that 
occurred.  Finally,  due  to  the  high  P-value  of  regression,  found  in  both  the  regression  of 
all  values  and  the  median  values  of  percent  cost  growth,  it  can  not  be  concluded  that  cost 
growth  increased,  or  decreased  for  contracts  awarded  between  the  years  1986  -  1994. 
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V.  Conclusions 


Overview 

The  conclusions  section  of  this  research  focus  on  three  areas:  (1)  a  reiteration  of  the 
research  question,  (2)  a  summary  of  the  literature  and  results  that  apply  to  answering  the 
research  question  and  their  implications,  (3)  recommendations  and  possible  future  areas 
for  research  and  (4)  lessons  learned. 

Research  Question 

This  research  effort  focused  on  the  following  question:  what  are  the  extent  and  causes  of 
cost  growth  in  outsourced  base  support  functions  at  USAF  bases? 

To  clarify  the  causes  of  cost  growth  the  following  were  employed: 

(1)  A  review  of  the  Federal  Acquisition  Regulations  (FAR)  in  order  to  understand 
how  cost  growth  can  occur  within  the  context  of  USAF  contracts. 

(2)  A  review  of  current  literature  and  government  publications  concerning  cost 
growth  in  USAF  as  well  as  other  government  contracts. 

(3)  A  review  of  cost  growth  in  the  construction  industry  in  order  that  possible 
further  insights  could  be  gained,  since  little  information  exists  concerning  cost 
growth  in  service-type  contracts  and  much  research  has  been  conducted  in  the 
construction  industry. 
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To  clarify  the  extent  and  explore  the  various  factors  (MAJCOM,  contract  function, 
contract  type,  and  award  year)  the  following  statistical  analysis  on  124  USAF  base 
support  function  contracts  was  employed: 

(1)  Descriptive  statistics  in  order  to  present  an  overall  understanding  of  the  extent 
of  cost  growth  within  the  aforementioned  factors. 

(2)  Kruskal-Wallis  and  Mann-Whitney  tests  for  statistical  differences  between 
variables  within  factors  were  used  because  parametric  tests  were  not  appropriate 
due  to  non-normality. 

(3)  Regression  analysis  in  order  to  determine  whether  cost  growth  is  increasing, 
decreasing,  or  remaining  constant  over  time  for  the  factor  award  year  of  contract. 

Summary  of  Literature  and  Results  and  Implications 

From  the  literature  reviewed  in  this  research,  the  following  can  be  concluded.  First, 
changes  to  the  statement  of  work  (SOW)  or  performance  work  statement  (PWS),  and 
changes  to  the  Department  of  Labor  (DOL)  mandated  wage  rate,  due  to  the  Service- 
Contract  Act,  are  the  primary  causes  of  cost  growth  in  USAF  base  support  function 
contracts.  Second,  the  causes  of  cost  growth  in  the  construction  industry  are  similar  to 
causes  of  cost  growth  in  USAF  base  support  function  contracts.  The  implications  of 
these  two  conclusions  are  discussed  next. 

According  to  the  FAR,  excluding  the  Service-Contract  Act,  changes  to  the  SOW  or  PWS 
can  be  the  result  of  two  causes:  (1)  error  on  the  part  of  the  person  who  wrote  the  SOW  or 
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PWS  for  failing  to  include  or  underestimating  a  requirement,  or  (2)  an  unforeseen 
requirement  occurs  and  needs  to  be  addressed  after  the  SOW  or  PWS  is  written. 

With  respect  to  the  latter,  there  is  really  nothing  that  can  be  done  when  writing  the 
original  PWS  or  SOW,  except  to  make  the  document  as  flexible  (easily  adapted)  as 
possible  to  accommodate  the  unforeseen  change.  Even  so,  such  changes  are  likely  to 
come  at  a  price. 

With  respect  to  error  on  the  part  of  the  person  who  wrote  the  SOW  or  PWS  and  failed  to 
include  or  underestimated  a  requirement,  this  research  suggests  the  USAF  look  toward 
solutions  that  have  worked  in  the  construction  industry.  This  is  due  to  the  following  two 
reasons:  (1)  numerous  research  efforts  have  been  conducted  in  the  construction  industry 
for  controlling  cost  growth,  and  (2)  this  research  has  shown  the  causes  of  cost  growth  in 
the  construction  industry  are  similar  to  causes  of  cost  growth  in  USAF  base  support 
function  contracts. 

The  other  cause  cited  in  this  research  as  a  primary  cause  of  cost  growth  was  DOL 
mandated  wage  rate  changes  in  accordance  with  the  Service-Contract  Act.  Although,  this 
type  of  change  is  beyond  the  control  of  the  USAF,  it  nevertheless  should  be  able  to  be 
predicted  in  the  form  of  an  economic  model.  The  requirements  of  such  a  model  would 
include  but  not  be  limited  to  predictors  of  local  price  indexes,  and  predictors  of  specific 
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trades/professions.  Incorporation  of  such  a  model  would  allow  these  wage  rate  increases 
to  not  only  be  predicted  but  also  budgeted  for  future  contract  years. 

Overall  with  respect  to  the  causes  of  cost  growth,  this  research  provides  a  valuable 
summary  of  causes  from  various  sources,  but  was  unable  to  provide  much  insight  as  to 
the  specific  (i.e.,  was  the  change  caused  by  defective  specifications,  formal  change, 
constructive  change,  delays,  etc.)  causes  of  cost  growth  in  USAF  base  support  functions. 

From  the  statistical  analysis  of  124  USAF  base  support  function  contracts  the  several 
things  can  be  concluded.  First,  cost  growth  does  oecur  in  the  great  majority  of  USAF 
base  support  funetion  contracts.  The  distribution  of  the  percent  of  cost  growth  for  all  of 
the  contracts  analyzed  can  be  most  closely  associated  with  the  Johnsonsu  distribution; 
however,  the  distribution  is  non-symmetrical  with  a  skew  towards  positive  cost  growth 
(76%  of  all  contracts  experienced  positive  cost  growth).  With  respect  to  the  four  factors 
analyzed  in  this  research  (MAJCOM,  contract  function,  contract  type,  and  award  year  of 
contract),  the  following  could  be  concluded.  One,  relative  differences  in  percent  cost 
growth  between  the  variables  within  the  factors  MAJCOM,  contract  function,  and  award 
year  of  contract  do  exist;  however,  no  statistical  differences  existed.  In  other  words,  no 
MAJCOM  was  actually  significantly  different  from  the  other  MAJCOMs,  no  contract 
function  was  actually  significantly  different  than  the  other  contract  functions,  and  no 
award  year  of  contract  was  actually  significantly  different  from  the  other  award  year  of 
contracts. 
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The  lack  of  light  shed  with  respect  to  the  previous  paragraph  is  unfortunate.  Without  any 
actual  differences  between  MAJCOMs,  or  contract  functions,  the  USAF  cannot  look  at 
one  MAJCOM  or  contract  function  that  is  experiencing  less  cost  growth  and  apply  that 
MAJCOMs  or  contract  functions  techniques,  procedures,  or  polices  to  other  MAJCOMs 
or  contract  functions.  In  other  words,  with  respect  to  available  information  used  in  this 
research,  the  USAF  cannot  learn  from  itself  how  to  limit  cost  growth. 

Cost  growth  of  firm-fixed-price  contracts  was  shown  to  be  statistically  less  than  other- 
than-firm-fixed  price  contracts  at  the  0.10  level  of  significance,  indicating  a  probability  of 
lesser  cost  growth.  However,  this  is  not  all  that  surprising  of  a  revelation.  Normally,  a 
firm-fixed  price-contract  is  written  in  a  situation  where  a  firm  grasp  upon  the 
requirements  is  present.  Other  contract  types  are  written  in  a  situation  the  requirements 
of  the  contract  may  not  be  firmly  understood.  Simply,  other  contract  types  are  used  in 
order  to  allow  a  contract  to  “grow”  to  meet  the  requirements.  Perhaps  more  surprising  is 
that  the  difference  was  not  found  to  be  significant  at  the  0.05  level  of  significance. 

Linear  regression  could  not  identify  whether  cost  growth  was  increasing,  or  decreasing 
from  1986  through  1994.  This  in-determinability  is  unfortunate  because  the  USAF 
cannot  determine  on  the  basis  of  the  available  data  whether  it  is  doing  any  “better”  with 
respect  to  cost  growth  or  learning  over  time  how  to  “control”  cost  growth. 
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Overall,  with  respect  to  the  extent  and  factors  associated  with  cost  growth,  this  research 
presented  the  extent  of  cost  growth  for  not  only  all  contracts  collectively,  but  also  for  the 
four  factors  analyzed.  This  research  also  was  able  to  conclude  that  the  variables  within 
the  factors  MAJCOM,  contract  function,  and  award  year  are  no  different  from  one 
another,  thus  indicating  that  cost  growth  is  not  isolated  to  a  particular  MAJCOM,  contract 
function,  or  year. 

Recommendations 

During  the  course  of  this  research  several  items  for  recommendation  stood  out.  First,  the 
USAF,  an  organization  which  has  outsourced  a  significant  portion  of  their  commercial 
activities  already  and  plans  to  outsource  more  in  the  future,  does  not  have  a  central 
database  to  track  the  costs  of  these  contracts.  A  database  called  the  Commercial 
Activities  Management  Information  System  (CAMIS)  does  exist;  however,  CAMIS 
tracks  only  the  commercial  activity  and  its  costs  for  three  years  once  it  is  outsourced. 

After  the  three  years  the  commercial  activity,  under  succeeding  contracts,  is  virtually 
forgotten.  The  CAMIS  database  could  be  modified  in  order  to  track  outsourced  activities 
throughout  their  life. 

Second  an  economic  model  could  and  should  be  developed  that  would  allow  cost 
estimators  of  contracts  to  account  for  future  changes  to  the  DOL  mandated  wage  rate. 
Such  a  model  would  allow  for  future  wage-rate  increases  to  be  accounted,  planned,  and 
budgeted  for  in  future  contract  years. 
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Finally,  further  analysis,  similar  to  this  research  should  be  accomplished  using  the 
changes,  as  defined  in  the  Federal  Acquisition  Regulations,  as  variables  for  defining, 
modeling,  or  predicting  the  causes  of  cost  growth.  In  reality  such  an  effort  would  be  quite 
an  intensive  effort.  This  is  due  to  the  fact  every  contract  included  for  analysis  would  have 
to  be  viewed  at  the  location  of  the  contract  and  in  a  similar  manner  to  ensure  contract 
extensions  were  not  included  in  the  calculation  of  percent  cost  growth  of  the  contract. 

This  type  of  research  would  provide  vast  amounts  of  insight  into  the  causes  as  well  as 
possible  solutions  for  “controlling”  cost  growth. 

Lessons  Learned 

During  the  course  of  this  research,  several  unsuccessful  analyses  were  attempted.  Those 
analyses  included  (1)  use  of  the  General  Linear  Model,  (2)  attempting  to  correlate  initial 
award  cost  with  percent  of  cost  growth,  and  (3)  introducing  additional  various  factors  into 
the  analysis. 

The  General  Linear  Model  (GLM)  was  attempted  both  by  the  least  squares  and  stepwise 
regression;  however,  the  lack  of  data  resulted  in  lost  degrees  of  freedom.  Reducing  the 
variables  within  factors  could  have  resulted  in  the  successful  implementation  of  the 
GLM;  however,  considerable  resolution  with  respect  to  reality  would  be  lost  (i.e.,  how  the 
Air  Force  is  organized  and  operating). 
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The  relationship  between  cost  growth  and  initial  award  amount  of  contract  was  explored; 
however,  no  relationship  could  be  determined.  The  amount  of  cost  growth  that  occurred 
in  the  data  represented  a  random  stochastic  process.  For  this  reason,  this  was  not 
included  in  the  analysis. 

Creation  of  more  factors  and  associated  variables  beyond  what  was  in  the  existing  data 
was  also  explored.  Categorizing  the  data  into  regions  (i.e..  Eastern,  Southeastern, 
Northern,  etc.)  of  the  United  States  was  attempted,  but  not  included  in  this  research  for 
two  reasons.  One,  it  produced  no  results,  and  two  the  USAF  does  not  operate  on  a 
geographic  basis.  The  factor  MAJCOM  best  represented  how  the  USAF  operates. 
Categorizing  the  data  into  high  or  low  cost  standard-of-living  areas  was  also  attempted, 
but  like  the  geographic  idea  it  produced  no  results  and  was  not  included  in  the  analysis. 
In  fact,  many  possibilities  existed  for  additional  categorizing  of  the  data;  however,  all 
were  dismissed  because  of  their  failure  to  represent  realistically  the  organization  or 
processes  the  USAF  actually  undertakes. 
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Appendix  A:  Summary  of  Data 
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Adjusted 

Original  Final  Total  Final  Adjusted  Percent 

Rec  MAJ  Award  Contract  Contract  Cost  Contract  Cost  Cost 

#  Location  COM  Description  Type  Date  Cost  Cost  Growth  Cost  Growth  Growth 
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112  1  Wright-Pat  I  AFMC  I  BITC  92-97  I  FFP  I  01 -Jan-92 1  $3,201,389  I  $3,718,868  I  $517,479  I  $3,345,880  I  $144,491  I  4.51 


Appendix  B:  Calculation  of  Z-Value  used  in  Mann- Whitney  Test 


UStat  pprp '  ~  i  156 
Samples izeppp  :  =  89 

SampleSizcQ'pp^pj^'PYPE  " 


UStat 


FFP- 


SampleSizepFp'SampleSizeQ'pj^pj^'PYP^ 


^SampleSizepFp'SampleSizeQ'j’jipi^'PYP]^  ’^SampleSizeppp-i-  j 

_ 


z  =  -1.801 


Performed  with  MathCad  7.0 
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